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Abstract. The exponential family of random graphs is among the most promising class of 
network models. Dependence between the random edges is defined through certain finite sub- 
graphs, in imitation of the use of potential energy to provide dependence between particle 
j^JQf states in a grand canonical ensemble of statistical physics. By adjusting the specific values of 

^ ' these subgraph densities, one could analyze the influence of various local features on the global 

structure of the network. Loosely put, a phase transition occurs when a singularity arises in 
the limiting free energy density, as it is the generating function for the limiting expectations 
of all thermodynamic observables. We derive the full phase diagram for a large family of 3- 
parameter exponential random graph models with attraction and show that they all consist of 
a first order surface phase transition bordered by a second order critical curve. 

^: 



1. Introduction 

The exponential family of random graphs is one of the most widely studied network models. 
Their popularity lies in the fact that they capture a wide variety of common network tendencies, 
such as connectivity and reciprocity, by representing a complex global structure through a set 
of tractable local features. The theoretical foundations for these models were originally laid by 
Besag pQ , who applied methods of statistical analysis and demonstrated the powerful Markov- 
Gibbs equivalence (Hammersley-Clifford theorem 0) in the context of spatial data. Building 
on Besag's work, further investigations quickly followed. Holland and Leinhardt [3] derived 
the exponential family of distributions for networks in the directed case. Frank and Strauss 
[1] showed that the random graph edges form a Markov random field when the local network 
features are given by counts of various triangles and stars. Newer developments are summarized 
in Snijders et al. [5] and Rinaldo et al. [BJ. (See Wasserman and Faust [7] for a comprehensive 
review of the methods and models for analyzing network properties.) 

As usual in statistical physics, we start with a finite probability space, namely the set Q n of all 
simple graphs on n vertices ("simple" means undirected, with no loops or multiple edges). The 
general fc-parameter family of exponential random graphs is defined by assigning a probability 
mass function ¥n(G n ) to every simple graph G n € Q n : 



= exp (n'ifrtiHu £„) + ••• + f3 k t(H k , G n ) - <)J , (1) 

where (3 = (/3i, (3 k ) are k real parameters, H\,...,H k are pre-chosen finite simple graphs 
(in particular, H\ is a single edge), t(Hi,G n ) is the density of graph homomorphisms (the 
probability that a random vertex map V(Hj) — > V(G n ) is edge-preserving), 

tfrr r \ - \ hom ( H i,G n )\ 

1 " nj ~ \v(G n )\wm\' { ' 
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and ipn is the normalization constant (free energy density), i.e., it satisfies 

J2 exp (n 2 {p x t{H x ,G n ) + ■■■ + fat(H k , G n ))) = exp (n 2 ^) . (3) 

n 

Since real-world networks are often very large in size, ranging from hundreds to billions of 
vertices, our main interest will be in the behavior of the exponential random graph G n in 
the large n limit. Intuitively, the k parameters /3i,...,/3fc allow one to adjust the influence of 
different local features (in this case, densities of different subgraphs Hi, on the limiting 
probability distribution, and a natural question to ask is how would the tuning of parameters 
impact the global structure of a typical random graph G n drawn from this model? Loosely put, 
a phase transition occurs when the limiting free energy density ip^ = lim ip? h as a singular 

n— >oo 

point. The reason behind this is that the limiting free energy density is the generating function 
for the limiting expectations of all thermodynamic observables (see for instance [8]), 

lim E?t(H u G n ) = lim — < = — (4) 

n-+oo n-s-oo (jpi Opi 

lim n 2 (Cov' 3 (t(Hi, G n ), t(Hj, G n ))\ = hm J^T^ = J^r^L (5) 

n->oo V / n->oo OpiOPj OPiOPj 

so a singularity in the limiting thermodynamic function must arise from a singularity in the 
limiting free energy density. 

Definition 1.1. A phase is a connected region of the parameter space {/3}, maximal for the 
condition that the limiting free energy density ip^ is analytic. There is a jth-order transition at 
a boundary point of a phase if at least one jth-order partial derivative of ip^o is discontinuous 
there, while all lower order derivatives are continuous. 

For k = 1, it has been well established that the exponential model is equivalent to the 
famous Erdos-Renyi random graph G(n, p) [9], and its structure is completely specified by the 
edge formation probability p = e 2 ^ 1 /(l + e 2/?1 ). As p increases, the model displays a sharp 
phase transition: From a low-density state in which there are few edges to a high-density state 
in which an extensive fraction of all vertices are joined together in a single giant component. 

For k = 2, the situation is understandably more complicated and has attracted enormous 
attention in recent years: Park and Newman [TO] [11] developed mean-field approximations 
and analyzed the phase diagram for the edge-2-star and edge-triangle models. Chatterjee and 
Diaconis [12] gave the first rigorous proof of singular behavior in the edge-triangle model with 
the help of the emerging tools of graph limits as developed by Lovasz and coworkers [13] . There 
are also related results in Haggstrom and Jonasson [14J and Bhamidi et al. [15] . Radin and 
Yin [16] derived the full phase diagram for 2-parameter exponential random graph models with 
attraction (/?2 > 0) and showed that they all contain a first order transition curve ending 
in a second order critical point. Aristoff and Radin [17] treated 2-parameter random graph 
models with repulsion (/?2 < 0) and proved that the region of parameter space corresponding to 
multipartite structure is separated by a phase transition from the region of disordered graphs 
(their proof was recently improved by Yin). 

One of the key motivations for considering exponential random graphs is to develop models 
that exhibit transitivity and clumping (i.e., a friend of a friend is likely also a friend). However, 
as seen in experiments and through heuristics [TTJ, it is often futile to model transitivity with 
only 2 subgraphs H\ and H2 as sufficient statistics. To get around this problem, more local 
features of the random graph G n need to be captured pJ2]. We therefore incorporate the density 
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of one more subgraph #3 into the probability distribution and study the phase structure of the 
exponential model in the k = 3 setting. Our main results are the following. 

Theorem 1.2. Consider a ^-parameter exponential random graph model HP- Assume H2 has 
p edges and H% has q edges with 2<p<q<5p — 1. Then the limiting free energy density 
i/jPq exists at all {(fli, P2, P3) : fii > 0, (3s > 0}, and is analytic except on a certain continuous 
surface S which includes three bounding curves C\, C2, and C3: The surface S approaches the 
plane f3\ + + @3 = as (3\ — > —00, /?2 — > 00, and j3s — > 00; The curve C\ is the intersection 
of S with the (/3i,/32) plane {(Pi, P2, P3) '■ P3 = 0}; The curve C2 is the intersection of S 
with the (/3i,/?3) plane {(/3i, P2, /%) : P2 = 0}; The curve C3 is a critical curve, and is given 
parametrically by 

n , . 1, u 1 pu — (p - 1) 

Pxiu) = -log— — -— - — — - + 



2 °l-u 2(p-l)(l-u) 2{p - l)(q - - uf 

qu-{g- 1) 

2p(p — l)(p — q)uP~ l (\ — u) 2 ' 



a 1 \ _ pu- (p- 1) 

P3{U) 2q{q-l){q-p)ui- l {l-uY' {> 

p — 1 q — 1 

where we take < u < to meet the non-negativity constraints on /?2 and /?3 (see 

V Q 

Figure^). All the first derivatives tt-j-V^j ^Tr^oo; an d ~x7T' l l J oo have (jump) discontinuities 

dpi 0P2 ap 3 

across the surface S, except along the curve C3 where, however, all the second derivatives 

mmf^ aim^' and dwerge - 

Corollary 1.3. The parameter space {(Pi, 02, P3) : /?2 > , /3 3 > 0} consists of a single phase 
with a first order phase transition across the surface S and a second order phase transition 
along the critical curve C3. 

To derive these results, we will make use of two theorems from [12], which connect the 
occurrence of a phase transition in our model with the solution of a certain maximization 
problem (a more extensive explanation may be found in |13j). 

Theorem 1.4 (Theorem 4.1 in [E]). Consider a general k-parameter exponential random graph 
model fTJj. Suppose /?2,---,/3fc are non-negative. Then the limiting free energy density ip^ exists, 
and is given by 

V& = sup (p lU E ^ + --- + p k u E ^-\u\ogu-\(l-u)\og(l-u)], (7) 

0<u<l \ I I J 

where E(Hi) is the number of edges in H{. 

Theorem 1.5 (Theorem 4.2 in |12j). Let G n be an exponential random graph drawn from fip. 
Suppose Pii—iPk are non-negative. Then G n behaves like an Erdos-Renyi graph G(n,u*) in 
the large n limit, where u* is picked randomly from the set U of maximizers of fiTty. 

The rest of this paper is organized as follows. In Section [2] we analyze the maximization 
problem (JT|) for k = 3 in detail (Proposition I2.ip and describe the transition surface S and 
the bounding curves C%, C%, and C3 explicitly (Proposition 12. 3p . In Section [3] we investigate 
the analyticity properties of the limiting free energy density ipoo in different parameter regions 
(Theorems 13.11 and I3.3|) and complete the proof of our main theorem (Theorem II -2|) . 
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Figure 1. Phase transition surface S and critical curve C3. Graph drawn for 
p = 3 and q = 5. 



2. Maximization Analysis 

Proposition 2.1. Fix (3% and integers p and q with 2<p<q<5p — 1. Consider the 
maximization problem for 



lp 3 (u; (3i, /3 2 ) = fiiu + f3 2 u p + /3 3 u q - -ulogu- ~(1 - u) log(l - u) 



(8) 



on t/ie interval [0, 1], where —00 < /3i < 00 and —00 < f3 2 < 00 are parameters. Then there is 
a V-shaped region in the ((3i,f3 2 ) plane with corner point (Pi,/3 2 ), 



PI 



- log — 

2 6 1 



Uq 



1 



+ 



PUQ - (p - 1) 



-uo 2(p-l)(l-«o) 2(p-l)(g-l)(l 
gu - (g - 1) 



2p(p-l)(p-9)wo ^l-uo) 2 ' 
where uq is uniquely determined by 

pu Q -(p-1) 



1% 



2<?(g - l)(q-p)u q l (l - u 



(9) 



(10) 



Outside this region, l/3 3 (u) has only one local maximizer (hence global maximizer) u* ; Inside this 
region, lp 3 {u) has exactly two local maximizers u* and u\. For every (3i inside this V-shaped 
region (j3\ < there is a unique decreasing (3 2 = rp 3 (f3i) such that u\ and U2 are both global 
maximizers for lp 3 (u; f3i,rp 3 (/3i)) (see Figures^ andEjj. 
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Figure 3. The phase transition curves r(/3i) (corresponding to ^3 = 0, /?3 = 1, 
and @3 = 2) in the (/3i, fa, $3) space. Graph drawn for p = 3 and q = 5. 
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Figure 4. Outside the V-shaped region, Ir 3 (u) has a unique local maximizer 
(hence global maximizer) u* . Graph drawn for @\ = 2, /?2 = —4, (3^ = 2, p = 3, 
and q = 5. 



Proof. The location of maximizers of l/3 3 (u) on the interval [0, 1] is closely related to the prop- 
erties of its derivatives l'^ (u) and lp 3 (u) : 

l> (u) = j3 l +p /3 2U P-i + q /3 3U <i-i - ilog-^-, (11) 
HA 2 1 — u 



I'kiu) = P(P ~ mu p ~ 2 + q(q ~ 1)/W 2 ~ - • (12) 



1 

2u(T- u) 

We first analyze the properties of lp 3 (u) on the interval [0, 1]. Consider instead 



F'(u) = q(q -l)(q- p)^'^ 1 + K 2 ■ (14) 



F(u) = p(p - l)/3 2 + q(q - l)fou*-* - -, (13) 

2uP i (l — Uj 

which is obtained by factorizing u p ~ 2 out of l'l(u). Note that in doing so the effect of 02 is 
minimized as varying only shifts the graph of F(u) upward/downward and does not affect 
its shape. To examine the effect of (3^ on F(u), we take one more derivative, 

,-i , (g ~ 1) ~ pu 
2vP(l - uf 

Similarly as before, we factor u q ^ p ^ 1 out of F'(u) to minimize the effect of (3%. Let 

u 9 (1 — 

so that 

F'{u) = ^-P- 1 (2q(q - l)(q - p)fo + /(«)). (16) 

We claim that the condition 2<p<q<5p — 1 guarantees that /(it) is monotonically 
decreasing on [0, 1]. Independent of p and g, /(0) = oo and /(l) = -co. Its derivative f'(u) is 
given by 

.,, , _ pgn 2 + (g + g + 1 - 2pq)u + (p - l)(q - 1) 
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Figure 5. Outside the V-shaped region, lp 3 (u) has a unique local maximizer 
(hence global maximizer) u* . Graph drawn for (3\ = 2, f3 2 = —2.5, = 2, p = 3, 
and q = 5. 

Rearranging terms in the discriminant A of the numerator of f'(u) yields a quadratic equation 
in q, 

A = q 2 + 2(l-3p)q + (p+l) 2 (18) 

with two zeros 

q 1>2 = (3p - 1) ± 2V2(p 2 -p). (19) 

We can easily check that q\ < p and q 2 > 5p — 1. As (71 < g < q 2 is equivalent to A < 0, this 
verifies our claim. 

An immediate corollary is that there is a unique uq in (0, 1) such that F'(uq) = 0, with 
F'(u) > for u < no, and F'{u) < for n > uq. The correspondence between (3% and no is 
one-to-one, and we may alternatively describe /S3 by 

pu -(p-1) 

2q(q-l)(q-p)u q - 1 (l-u f 

This further implies that F{u) is increasing from to no, and decreasing from no to 1, with the 
global maximum achieved at no, 

gup - {q - 1) 
- V p)«g '(1 "0 

Let 

gup - (q - 1) 
2p(p - l)(p - q)u P o~ (1 - n ) 2 
so that F(uo;fi2) = 0- As F(u) an d ^ 3 ( u ) always carry the same sign, this shows that for 
fi 2 < P 2 , l'i3 s ( u ) < on the whole interval [0,1]; whereas for f3 2 > P 2 , ^a 3 ( n ) takes on both 
positive and negative values, and we denote the transition points by u± and u 2 (u± < no < u 2 ), 
which are solely determined by (3 2 , and vice versa. Let 

m ( U ) = 1 + (P-1)- P UQ 

2p(p-l)uP' 1 (l-u) 2p(p-l)(q-p)u q - l (l-u ) 2 



= ^0 - ^ - tl (2Q) 



F(u ) = p{p - l)P 2 + - ^ ™ ±J (21) 



& = ~ ^ - (22) 
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Figure 6. Along the lower bounding curve m(6(/3i)) of the V-shaped region, 
l'g 3 (u) has two zeros u\ and u^, but only u* is the global maximizer for lp 3 (u). 
Graph drawn for fli = 2, /?2 = —3.24, = 2, p = 3, and q = 5. 

so that /?2 = m(ui) = m(u2). As m(u) = 02 — F(u) /p(p — 1), we have m(0) = m(l) = oo, m(u) 
is decreasing from to Uq, and increasing from uq to 1. 

Based on the properties of lp 3 (u), we next analyze the properties of l's 3 (u) on the interval 
[0,1]. For /?2 < /Sf, Vj3 3 { u ) is monotonically decreasing. For /3 2 > $21 ^s 3 ( n ) ^ s decreasing from 
to u\, increasing from u\ to 112, then decreasing again from 112 to 1. For reasons that will 
become clear in a moment, we write down the explicit expressions of Va{u\) and l'p 3 {u2)'- 

,i 1 \ a 1 X i u l (p-l)-p«o g-i , 

tfl, = Pi H ; 77 r log = u? , 24 

M u 2( P -l)(l-m) 2 S l- Ul 2 (p-l)( ? -lK- 1 (l- U o) 2 

It / \ a 1 1 «2 , (p-l)-JMio g-1 

Ir„(U2 = Pi H ; 77 r log 1 it, . 25 

PiK ' m 2(p-l)(l-« 2 ) 2 S l- U2 2(p-l)( g -lK- 1 (l-n ) 2 2 1 ' 

Finally, based on the properties of 1'r 3 {u) and lp 3 {u), we analyze the properties of Ir 3 {u) on 
the interval [0, 1]. Independent of p and q, lp 3 {u) is a bounded continuous function, l'g 3 (0) = 00, 
and ^(l) = —00, so lp 3 {u) can not be maximized at or 1. For @2 < P21 l'p 3 ( u ) crosses the 
it-axis only once, going from positive to negative. Thus lp 3 {u) has a unique local maximizer 
(hence global maximizer) u*. For 02 > P21 the situation is more complicated. If Vo(u\) > 
(resp. I'p 3 {ii2) < 0), l/3 3 (u) has a unique local maximizer (hence global maximizer) at a point 
u* > U2 (resp. u* < u\). If Vp {u\) < < l'g (vq), then Ir 3 {u) has two local maximizers u\ and 
«2, with u\ < u\ < uq < U2 < u\ (see Figures [H and [5]) . 

Let 

n(u ) - I I w + (p-l)-pno U 9-1 (26) 

nW " 2(p - 1)(1 - u) 2 l0g 1 - u + 2(p _!)(,_ i )tl g-i(i _ Uo)2 " (26) 

so that l'p {u\) = fii + n{u\) and l'p (112) = Pi + n(w 2 )- Independent of p and n(0) = 00 and 
n(l) = 00. Its derivative n'(u) is given by 

,, \ 1 -2 f (p-l)-jwto (p-l)-pu 

n (it) = ' ' ' 




2 



(27) 
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Figure 7. Along the upper bounding curve m(a(0i)) of the V-shaped region, 
l'g 3 (u) has two zeros u\ and u\, but only u\ is the global maximizer for lg 3 (u). 
Graph drawn for 0i = 2, 2 = —2.7, 03 = 2, p = 3, and q = 5. 

As /(n) is monotonically decreasing, n(n) is decreasing from to no, and increasing from no to 
1, with the global minimum achieved at no, 



n(u ) 



2(p-l)(l-«o) 
This implies that Z# 3 (wi ; 0i , 0§ ) > for 

u 



1 , ^0 
- log 

2 & 1 



+ 



(p-1) 



pn 



Pi > ft 



- log ■ 

2 & 1 



1 



+ 



2(p -1)(1- n ) 2 ' 

PUQ ~ (p 



1) 



(28) 



(29) 



n 2(p-l)(l-«o) ' 2(p-l)(g-l)(l-n ) 2 " 
The only possible region in the (0i,0 2 ) plane where l'g 3 {u\) < < l'p 3 (u2) is thus bounded by 
ft < 0f and 2 > 0|. 

We now analyze the behavior of l'g 3 (ui) and l'g 3 (u2) more closely when 0i and 02 are chosen 
from this region. Recall that u\ < uq < U2- By monotonicity of n(u) on the intervals (0,no) 
and (no,l), there exist continuous functions a(0i) and 6(0i) of 0i, such that l'n(u\) < for 
ui > a(0i) and ^ 3 (n 2 ) > for n 2 > b(0i). As 0i ->• -00, a(0i) ->■ and 6(0i) -> 1. a(0i) is 
an increasing function of 0i, whereas b(0i) is a decreasing function, and they satisfy 

n(a(/3 1 )) = n(6(/3 1 )) = -/3 1 . (30) 

The restrictions on u\ and n2 yield restrictions on 02, and we have (ni) < for 02 < ^(o(0i)) 
and Z^ 3 (1*2) > for 02 > m(6(0i)). As 0i — )■ —00, m(a(0i)) — > 00 and m(fo(0i)) — > 00. m(a(0i)) 
and m(6(0i)) are both decreasing functions of 0i, and they satisfy 

^ 3 (n 1 ;0 1 ,m(a(0i))) =Z^ 3 (n 2 ;0i,m(K0i))) = O. (31) 

As Z« 3 (n 2 ; 0i, 2 ) > Zo 3 (ni;0i,0 2 ) for every (0i,0 2 ), the curve m(6(0i)) must lie below the 
curve m(a(0i)), and together they generate the bounding curves of the V-shaped region in the 
(01) 02) plane with corner point (0f , 0|) where two local maximizers exist for lg 3 (n) (see Figures 
E| and ED- 

Fix an arbitrary 0i < 0J, we examine the effect of varying 02 on the graph of 1'q 3 (u). It is 
clear that l'a 3 (u) shifts upward as 02 increases and downward as 02 decreases. As a result, as 
02 gets large, the positive area bounded by the curve l'g (u) increases, whereas the negative 
area decreases. By the fundamental theorem of calculus, the difference between the positive 
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Figure 8. Along the phase transition curve r(0i), lp 3 {u) has two local maxi- 
mizers u\ and and both are global maximizers for lg 3 (u). Graph drawn for 
p 1 = 2, 2 = -2.95, 3 = 2, p = 3, and g = 5. 



and negative areas is the difference between lp 3 (ul£) and Z^ 3 (uJ), which goes from negative 
0>'fj 3 ( u 2) = 0, u* is the global maximizer) to positive (l'p 3 (ui) = 0, u 2 is the global maximizer) as 
02 goes from m(6(0i)) to m(a(0i)). Thus there must be a unique 02 : m(6(0i)) < 02 < m(a(0i)) 
such that u\ and are both global maximizers, and we denote this 02 by rg 3 (0i) (see Figure 
E}. The parameter values of (0i,t , /3 3 (0i)) are exactly the ones for which positive and negative 
areas bounded by l'g 3 (u) equal each other. An increase in 0i induces an upward shift of lp (u), 
and must be balanced by a decrease in 02. Similarly, a decrease in 0i induces a downward shift 
of l'p 3 (u), and must be balanced by an increase in 02. This justifies that rp 3 is monotonically 
decreasing in 0i- □ 



Corollary 2.2 (Universality). Fix 03 > 0. The transition curve 02 = rg 3 (0i) displays a 
universal asymptotic behavior as 0i — ^ —00: 

lim 1^3(0!) + 0i+ 03 1 =0. (32) 

pi—¥— 00 

Proof. By Proposition 12.11 it suffices to show that as 0i — > —00, lp 3 (u;Pi, — 0i — 03) has two 
global maximizers u\ and u\. This is easy when we realize that as 0i — > —00, lp 3 (u; 0i, — 0i — 
03) — > —00 for every u in (0, 1). The limiting maximizers on [0, 1] are thus u[ = and u\ = 1, 
with lp 3 (u*) = ^3(1*2) = 0. □ 

Proposition 2.3. ^4s 03 > varies, the transition curves 02 = r« 3 (0i) (subject to 02 > 0) 
trace out a continuous surface S with three bounding curves C\, Ci, and C3. 

Proof The continuity of the transition surface S follows easily once we realize that it consists 
exactly of parameter values of (0i, 02, 03) for which lp 3 (u) (continuous in 1; 02, and 03) has two 
global maximizers. By Corollary |2.2l S displays a universal asymptotic behavior: As 0i — > —00, 
02 — >■ 00, and 03 — > 00, the distance between S and the plane 0i + 02 + 03 = shrinks to zero. 
Due to the non-negativity constraints on 02 and 03, 5 is bounded by three curves C\, C2, and 
C3: The curve C\ is the intersection of S with the (0i, 02) plane, and is given by 02 = to(0i) 
(cf. Proposition 12. ip ; The curve C2 is the intersection of S with the (0i, 03) plane, and is given 
analogously (with p and q switched in ([8])); The curve C3 is a critical curve, and is traced out 
by the critical points (01,01) ® (subject to 0^ > 0). □ 
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3. Critical Behavior 

By Propositions 12. l l and 12.31 the maximization problem (JSj) is solved at a unique value u* off 
S, and at two values u\ and u\ on S (the jump from u\ to U2 is quite noticeable even for small 
parameter values of /3). Thus by Theorems II .41 and II. 51 in the large n limit, a typical G n drawn 
from ([T]) is indistinguishable from the Erdos-Renyi graph G(n,u*) off the transition surface S, 
however, on the transition surface S, the structure of G n is not completely deterministic: It 
may behave like an Erdos-Renyi graph G(n, u±), or it may behave like an Erdos-Renyi graph 
G(n,u\)- Since the limiting free energy density ^00 encodes important information about the 
local features of the random graph G n (see for example @ and ([5])), a thorough study of its 
analyticity properties is fundamental to understanding the global structure of the exponential 
model. The following theorems 13.11 and 13.31 are dedicated to this goal. Together they complete 
the proof of our main theorem (Theorem 11.21) . 

Theorem 3.1. Consider a ^-parameter exponential random graph model (Op. Assume H2 has 
p edges and H% has q edges with 2<p<q<5p — 1. Then the limiting free energy density ij)^ 
is not an analytic function on the transition surface S. 

Proof. Due to the jump between the two solutions u* and u\ of the maximization problem ([8]), 
all the first derivatives -r-rV^: -^Tr^^L, and — — ?/>£-, have (jump) discontinuities across the 
transition surface S, except along the critical curve C3: 

(33) 
(34) 
(35) 

To see that the transition across C3 is second-order, we check the first and second derivatives 
of V>oo hi the neighborhood of this curve. By Proposition 12. 1\ for every (/3f, Z^, P3) on C3, 
l'p 3 (u; Pi, /3 2 ) is monotonically decreasing on [0,1], and the unique zero is achieved at u$ (fTUj) . 
Take any < e < min{wo; 1 — uo}- Set 5 = min{^ 3 (uo — e), — l's 3 (uo + e)}- Consider (^1, /3 2 , P3) 
so close to (/3f , /?§, /3 3 ) such that |/3~i - j3f\ + p|/3 2 - /3f| + q\Pz - /3 3 | < 5. For every u in [0,1], 
we then have l'^(u; f3i, P2) — l'/3 3 ( u i Pi, P2) < K follows that the zero u*(/3i, /3 2 , ,$3) (or u\ 

d d 

and it 2 ) must satisfy \u* — uq\ < e, which easily implies the continuity of -^r^ooi "oTT^ocn ana ^ 

dpi OP2 

d 

— -~VSd at (Pi, P2, h)- Concerning the divergence of the second derivatives, we compute 

ops 

<^,p _d_ * 1_ S^ jP d _ P \u*) 2p - 2 f . 

dpf°° dpi u " i» 3 (u*y dpf°° dp 2 [u) ~ [ ) 

dpf°° dp 3 [u) ~ i» 3 (u*) ' dhdfh* 00 ~ dh Ku ' ~ [ ) 

92 - £w = = 4(«*) 5 = 08) 



lim EPt(H u G n 


) = lim E /3 t(i7 1 ,G(n,u*)) = 


= U* = 


a/3/ 00 ' 


lim ^t(H 2 ,G n ) 

n— >oo 


= lim EH(H 2 ,G(n 

n— )-oo 


«*)) = 


(u*) p 


= 


lim E^i(iJ 3 , G n ) 

n— >oo 


= lim E^t(H 3 ,G(n 


«*)) = 


( U y 


9/3 3 ^° 



9/3i9y3 3 ro ° 9/3/ ; ' a/3 2 0/3 3 ro ° <9/? 2 v 7 l'^(u*) 
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But as was explained in Proposition 12 .1\ as (Pi, P2, Pz) approaches C3, l'^(u*; Pi, P2) converges 
to zero. The desired singularity is thus justified. □ 

Real and complex analyticity are both defined in terms of convergent power series. To 
examine the analyticity of the limiting free energy density ip^o off the transition surface S, we 
resort to an analytic implicit function theorem, which may be interpreted in either the real or 
the complex setting. 

Theorem 3.2 (Krantz-Parks [H]). Suppose that the power series 

F{x,y) = J2a<*,kX a y k (39) 

a,k 

is absolutely convergent for \x\ < R\ and \y\ < i?2- U a o,o = and ao,i 7^ 0, then there exist 
ro > and a power series 

f{x) = ]T c a x a (40) 
such that (f^Op is absolutely convergent for \x\ < ro and F(x, f{x)) = 0. 

Theorem 3.3. Consider a 3-parameter exponential random graph model |ip. Suppose P2 and 
Pz are non-negative. Assume H2 has p edges and H3 has q edges with 2<p<q<5p — 1. 
Then the limiting free energy density i/j^ is an analytic function off the transition surface S. 

Proof. It is clear that l$ z (u; Pi, P2) is analytic for u € (0,1), Pi € (—00,00), $2 £ (—00,00), 
and P3 € (—00,00). We show that the maximizer u* for lp 3 (u; Pi, P2) is an analytic function 
of [3 off the transition surface S. Fix (Pi, P2, P3) not on S. For (^1,^2,^3) close to (Pi, p 2 , Ps), 
we transform the function l'* (u; Pi, $2) into a function F(x,y) by setting x = (Pi — Pi,p 



2 



P2, P3 — Ps) and y = u — u*(Pi, 02, Pz)- It is easy to check that F(x, y) satisfies all the conditions 
of Theorem 13.21 It has the desired domain of analyticity, is locally absolutely convergent, and 
its first two coefficients are given by 

a , = F(0,0) = 4 («*(&, Pi,p 2 ) = 0, (41) 

8F 

ao,i = -Q-M = # s &);ft,#0 + 0. (42) 

The absolute convergence for f(x) = u* (Pi , p 2 , P3 ) — u* (Pi, P2, P3) then follows easily, which 
implies the analyticity of u* as a function of p. As the composition of analytic functions is 
analytic as long as the domain and range match up, by Theorem 11.41 this further implies the 
analyticity of V'oo = lp z (u*', Pi, P2) as a function of P off the transition surface S, where the 
maximizer u* is uniquely defined. □ 
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